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Abstract 



H 

I We define zonal polynomials of quaternion matrix argument and deduce 

• some important formulae of zonal polynomials and hypergeometric functions 

, of quaternion matrix argument. As an application, we give the distributions 

of the largest and smallest eigenvalues of a quaternion central Wishart matrix 
W ~ QW{n, S), respectively. 

^ : 1 INTRODUCTION 

cn 

I Zonal polynomials and hypergeometric functions of real (or complex) symmetric ma- 

trices early introduced in [1] and [HI El [7j were used to study the density functions and 
the distributions of eigenvalues of Wishart matrices. Now they are very useful tools 
O ■ in the study of Multivariate Statistical Analysis. There are many ways of defining 

zonal polynomials. Some of them have appeared in [1], [5] and [TU]. Muirhead's defi- 
nition of zonal polynomials of a real matrix argument is an axiomatic definition which 



^ ' appeared in [9], involving partial differential operators. This definition is easier and 

more convenient for practical use. Gross and Richards defined zonal polynomials of 
a matrix argument over the division algebra F, including the real and complex fields, 
and quaternion division by means of the representation of groups. Maybe the authors 
thought there were some problems in their results, since they do not compute the 
numerical presentations of Ck{A) {A is a Hermitian quaternion matrix). 

In this paper, we modify the definition of zonal polynomials of a real matrix ar- 
gument given in [9] and define zonal polynomials of a quaternion matrix argument. 
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Then we compute the presentations of Ck{A). We also define quaternion hypergeo- 
metric functions in terms of zonal polynomials of a quaternion matrix argument and 
derive some useful formulas for quaternion hypergeometric functions. Using these re- 
sults, we give the distributions of the largest and smallest eigenvalues of a quaternion 
Wishart matrix W = A" A (i.e., W ~ QWm{n, J:),n^ m, A^ QA^„xm(0, 4 (g) S)). 

The paper is organized as follows. §2 provides the preliminary tools for deriving our 
results. The zonal polynomials and hypergeometric functions of a quaternion matrix 
argument will be studied in §3 and §4, respectively. In the last section, we will give 
the distributions of the largest and smallest eigenvalues. 



2 PRELIMINARY 



Following [13], let C and M denote the fields of complex and real numbers, respectively, 
and let Q denote the quaternion division algebra over M, i.e., every a G Q can be 
expressed as a = ai + + a^j + a^k, where k satisfy the following relations 



J 



k'^ = —1, ij = —ji = k,jk = —kj = i, ki 



-ik 



J- 



O'2'i — o-sj — ct^k and 



i2)V2. Let 



denote the set of all m x t?, matrices over M, C and Q, respectively. 



,mxn 

can be written as A 



{.ciij)mxn = ^1 + A2i + ^sj + where 



Put = ai — a2i — a-^i — a^k and ||a|| = (a^^a) 

j^m X n (J^m X n 

Any A e 

aij e Q, and Ai, A2, A^, A^ G W^"" . Ai is the real part of A, denoted by Re A. 
We also set Im (A) = A2, Jm (A) = A3 and Km (A) = A^. Put A^ = {afi)nxm = 
A'i — ^2% — A'^j — A'^k. We say A is Hermitian if A^ = A. The eigenvalues of a 
Hermitian matrix are all real. If the eigenvalues are all positive, then we say it is a 
positive definite quaternion matrix. 

Let tr(-) be the trace on Q"^" and put Retr (A) = tr(ReA) for A G Q"""". We 
have 

Retr (A) = ^tr {A + A^), Retr (AB) = Retr (BA), \/ A, B e Q"^". 

n 

Moreover, if A = G Q"'''', then Retr {A) = tr (A) = J2 ^s, where Ai, . . ., A„ are 

s=l 

the eigenvalues of A. Set qS{n) = {A e Q""""] A" = A} and 

gO(n) = {Ae A^'A = AA" = J4, ,Vn,n. = {A e Q"""| A^'A = /„}. 
Let A G Q"'"''' he A 

/ p R \ 

{Bi = Ai- A2i, B2 = A^- A^) 



A has the complex representation A^ 

and the real representations 

/ A2 A3 

-A2 Ai -A4 

-A3 A4 Ai 

-A4 -A3 A2 



Ai + A22 + A3j + A4A; = (Ai + Aaz) + (^s + ^^b' = B1 + B2J. 
Bi —B2 \ ,— 
B2 Bi 



\ 



and 2 A 



(A, 

A2 
A3 

V ^4 



A, \ 

^3 
A2 

A, ) 

For A G Q™^*^, denote by |A|g = det(A'^) and |A|d 
and double determinant of A, respectively; here 
quaternion matrix given in [13]. We have jA-'^ld 
Moreover, we have 



A, \ 
A3 
A2 

A,) 

A-'^AI the q-determinant 
is the determinant of a square 
A|d and |AU = |A|, (cf. [I3]). 



-A2 
Ai 
A, 

-A3 



-A3 
-A4 
Ai 
A2 
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Lemma 2.1. Let A G Q"''". 

(1) |A|2 = det(iA) = det(2A); 

(2) Let A = T^T, where T = {t 



ij Jnx n 



is an upper-triangular matrix with 



tii > 0, z = 1, . . ., m. Then \A\ =t(i---t: 



2 

nn ■ 



Proof. (1) Set Si 
Lemma 3.1], 



Ai -A3 
A3 Ai 



So 



A, 



-A 



-Aa -A 



Then by the proof of [HI 



1^1^ =1^1 



det 
det 



Ai + Aii -A3 - Aii 
A3 - Aii Ai - A2i 



Si + S2i 



Si - 82% 



det 



Note that 
-iS2 



-iS2 
^Si 



Si S2 
—S2 Si 



So \A\l = det 



Si S2 
-S2 Si 



det 



51 —S2 

52 Si 



(2) We have \A\ = \T\d = \T\g = det(T'^) 
with Ti, T2 G C"^" and Ti, T2 have the form 



det(S'i + 5*22) det(5'i — S2i) 



2Si -iS2 
-iS2 ISi 



51 —S2 

52 Si 



det(iA) = det(2A). 
= det f ^ 1 , where T 



Ti + T2J 



ft 



Ti 
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\ 



To 



/O 





v 



0/ 



respectively. A simple computation shows that det 



Ti -T2 
T2 Ti 



□ 



Let X = Xi + X2i + Xsj + X^k G Q™""" and Xi, X2, X3, X4 are m x n matri- 
ces of functionally independent real variables. Define the volume of X as (dX) = 
(dXi) f\{dX2) /XidXs) /XidX^), where (dX^), s = 1,2,3,4, are defined in [H|. 



Lemma 2.2. X, Y e Q'"^" and Y 
constant invertible matrices. 



AXB where A G 



and B G 



are 



(1) We have {dY) = |A|2"|S|2™((iX); 

(2) Suppose X G qS{m) and B = A^ . Then (dY) = {AH^'-^dX). 
Proof. (1) Let Y = AW and W = XB. Then dY = AdW, dW = dX B and 

{dY;, dY^, dYl, dYD' = {2A){dW[, dW^, dW!^, dW'^)' 
{dWi, dW2, dWs, dW^) = {dXi, dX2, dXg, dX^){iB). 
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Using the operator vec(-) (defined in [HI Definition 1.2]) to dXg, dYs and dWs, s 
1, . . ., 4, we have 



/vec(c/ri)\ 
vec{dY2 
vec^dY^, 

\YecldY4) ) 



/vec(rfW^i)\ 
vec(rfW2 
vec(o?VF3 

Vvec(dVF4) / 



(YQc{dWx)\ 
\Qc{dW2 

NQc{dW-i, 

\^Qc{dWi) ) 



/vec(dXi)\ 
Yec{dX2 
vec^dX^ 

\vec{dX4) ) 



by [HI Lemma 1.1] so that 



/vec(dri)\ 

vec((iF2 
vec((iy3 
\vec(dF4) / 



/vec(dXi)\ 
vec((iX2 
vec((iX3 

\vec(rfX4) y 



Thus by [HI Lemma 1.2] and Lemma [2.11 



{dY) = iiAri2sr(dx) = |si^"^(cix). 

(2) Since A is invertible, it follows from [131 Theorem 4.3] that A is the product 
of elementary quaternion matrices. Thus using the same method as in the proof of [HI 
Theorem 1.20], we can get the assertion. □ 

The following two lemmas, which come from [H p37, p38], will be used in this 
paper: 



Lemma 2.3. X G qS{m) with X > 0. Suppose X = T^T, where T = (t 
Qmxm upper-triangular matrix with real diagonal elements. Then 

m 

{dX) = 2'^Y[ti^"'-'^+\dT), 



ij Jmxm 



i=l 

,(1) , ,(2), , ,(3), 



m 4 m 

where {dT) = A dt,s A A d t^t = tli^ + t'^.'i + tf^'j + t'^^k, s < t, t = 1, . . .,m. 

s=l p=l s<t 



Lemma 2.4. Let Z = HiT G Q"^"^ with Hi G qVm,n! here T the upper triangular 
matrix with positive diagonal elements. Then we have 



(dZ) = l[tT-'^^\dT) A [H^dHi] 



i=l 

m n 

where (H^dHi) = A A h^^dhs for H = {Hi\H2) = {hi, . . ., h^\hm+i, ■ ■ hn). 

s=l t=s+l 

In this paper, we shall use the singularvalue decomposition (SVD) of a matrix in 
Qmxn follows. Let A G Q"*''" with rank A = r. Then there are U = (t/i|f/2) G 
qO{m), V = (V1IV2) G qO{n), with Ui G gK,m, Vi G qK,n such that 



A = U 



D 




V" = UiDV{ 



H 



( [T3I Theorem 7.2]), where D = diag (Ai, . . ., A,.) and Ai, . . ., Ar are the singular values 
of A. If v4 G qS{n) with rank A = r, then V and Vi can be taken as U and Ui in ([T]) 
respectively. 



4 



Lemma 2.5. Let X G Q'"''" with rankX = n < m. Let X = UDV^ with U G gK,m, 
V G qO{n) and D = diag(Ai, . . ., A„) (assume that Xi > X2 > ■ ■ ■ > Xn > 0). Then 

n n 

(1) [dX) = (27r2)-" n(A,' - A2)4 n Af"*-^"+=^(dD) f\{U''dU) MV'dV) for U ^V- 

j<i 1=1 

(2) (dX) = (27r2)-" f[{Xj - Xi)\dD) /\{U^dU) form = n and U = V, 

j<i 

n n 

where iV^dV) = /\vf^dv, for V = {vi---Vn), (U^dU) = f\ufdus for U = 

s<t s<t 

{Ui ■■■Un). 

Proof. The assertions can be found in [2], p241, p242]. But we must divide the volume 
elements by (27r^)" to normalize the arbitrary phases of elements in the first row of 
U. □ 

Corollary 2.6. Let X = UDV^ with X, U, D, V given in Lemma\MIE Put Z = 
X^X. Then 

n 

(dX) = 2-" JjAf™-'"+2(ciZ) A (U^dU) = 2~"|X|J"^-2"+i(ciZ) A {U^dU). 
1=1 

Recall that a quaternion variable X = Xi + X2i + X^j + X^k ~ QA^(0, 1) if 
Xi,X2,X3,X^ iid. A^(0, i). Thus X = ( 

Xij)nxm ^ Q"-^"* is Said to be the quaternion 
normal matrix QA^„xm(0, 4®/^) (or X ~ QA^nxm(0, In®Im)) if {xij\i = 1, . . .,n, j = 
l,...,m} iid. to QA^(0,1). It is easy to deduce that the density function of X ~ 
QiV„xm(0,/„®/„) is 

o2mn 

/W = ^exp(-2tr(X^X)). (2) 



By ([2]) and Lemma [2.41 we can get 

vol (K.,.) = / (i/f rfi/i) = = ^^^r^ (3) 

Jv^,„ nr[2n-2(?- 1)] ^^-^^'^^ 

i=l 

m 

where QT{a) = tt™"^™ [1 r(a - 2{i - 1)) (Re (a) > 2(m - 1)) (cf. (4.1) of P). 

i=l 

We call Y ~ QA^„xm(/i, 4®^) if y = fi+XB^", where X ~ QA^nxm(0, 4®/™), S = 
is invertible. By Lemma 12.11 and ([2]), we can write the density function of 
Y ~ QNnxmilJ', In ® S) as foUows: 

^^^^^^ exp(Retr (-2S-^(F - Mf{Y - M))). (4) 

Let W = Y^Y, we say W ~ QVK„(ri,S) (n ^ m), if y ~ QiVnxm(0,/„ ® S). W is 
called the quaternion central Wishart matrix and the density function of W is 

o2mn 

exp(Retr(-2S-iiy))|iy|2"-2-+i. (5) 



,(2n)|S| 



2n 



As applications of the theory of zonal polynomials of quaternion matrix argument, 
we discuss the distributions of the maximum and the minimum eigenvalues of W, 
respectively, in the last section. 



5 



3 ZONAL POLYNOMIAL FOR QUATERNION 
MATRIX 



The zonal polynomials of a Hermitian matrix are defined in terms of partitions of 
positive integers. Let A; be a positive integer; a partition k of k is written as k = 
(/ci, A;2, ■ ■ ■ )' where ki = k, with the convention, unless otherwise stated, that ki ^ 
k2 ^ where ki,k2,--- are non-negative integers. And if k = {ki, k2, ■ ' ') and 
A = {hj2,- ■ ■) are two partitions of k, we will write k > X if ki > li for the first index 
i for which the parts are unequal. 

Definition 3.1. Let Y G qS{m) with eigenvalues yi, y2, • • •, 2/m O'^d let k = [ki, k2, ■ ■ ■) 
be a partition of k into not more than m parts. The zonal polynomial ofY correspond- 
ing to K, denoted by C,^{Y) (in this paper, we use the symbol C^^^iY) to denote the 
zonal polynomials of Hermitian quaternion matrices for notational simplicity) is a 
symmetric homogeneous polynomial of degree k in the latent roots yi, . . .,ym such that: 

(i) The term of highest weight in Ci^{Y) is y^^, ■ ■ ■ , y^, that is, 

Ck{Y) = di^Vi^ ■ ■ ■ + terms of lower weight (6) 
where rf^ is a constant. 

(ii) C^{Y) is an eigenfunction of the differential operator Ay given by 

m. r,2 mm o a 

i=l ^* i=l j=l,jf^i ^ ^ 

(iii) As K varies over all partitions of k, the zonal polynomials have unit coefficients 
in the expansion of {tiY)^ , that is 

m 

{ilYf = {y,+y, + ... + y^f = ^ C^{Y). (8) 

K 

By the way, if we replace (ii) by (ii)' ■ 

(ii)' Ci^{Y) is an eigenfunction of the differential operator Ay given by 

m r,2 m m „2 ^ 

Then the conditions (i), (ii)' and (Hi) define zonal polynomials for Hermitian com- 
plex matrices. We can verify this definition of zonal polynomials is just coincide with 
the definition of zonal polynomials for Hermitian complex matrices in [H]. 

By using the same method as in the proof of P, Theorem 7.2.2], we can obtain the 
following: 

Lemma 3.2. The zonal polynomial Ck(F) corresponding to the partition k = [ki, k2, . ■ 
of k satisfies the partial differential equation 

AyC^iY) = [p« + k{4m - l)]C,{Y) (10) 
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where Ay is given by (7) and 

m 

P. = Xl^*(^*-4i) (ii; 



1=1 



If K = {ki,k2, . . .,km), the monomial symmetric function of 1/2, • • 2/m corre- 
sponding to K is defined as = Ui^ ■ ■ ■ + symmetric terms. For example, 

m 

Mi(y) = + ■ ■ ■ + y^, M^iY) =yl + ... + yl, M^^^{Y) = ^ yiyj 

i<j 

and so on. 

When k = l, qi) = try = 2/1 + ■■■ + ?/„ by (8). 

When k = 2, there is two partitions (1, 1), (2,0) by definition 13.11 and Lemma [3.21 
so we have following equations, 

C(2) =(i(2)M(2)(y) + /9M(i,i)(y) (12) 
qi,i)=(2-/3)M(i,i)(y) (13) 

AyC(2)(y)=(8m-6)C(2)(y) (14) 

We have (i(2) = 1 from above, since C(2) + C'(i^i) = (try)^. Also we can verify 

AyM(2)(y) =(8m - 6)Af(2)(y) + 8M(i,i)(y) (15) 
AyM(i,i)(y) =(8m - 12)M(i,i)(y). (16) 

4 

By means of (15), (16) and (14), we have /? = — by the following equation, 

(8m-6)(M(2)(y)+/3M(i,i)(y)) = (8m-6)M(2)(y) + 8M(i,i)(y) + (8m-12)/3M(i,i)(y). 

Then the two zonal polynomials for Hermitian quaternion matrices in the case k = 2 
are 

C7(2) = M(2)(y) + ^M(i,i)(y), C(i,i) = ^M(i,i)(y). 

Now we consider the case k = 3. We have three partitions (3), (2, 1), (1, 1, 1) when 
k = 3. Thus, 

C(3) =M(3)(y) + /?M(2,i)(y) + 7^(1,1,1) (y) 

C(2,i) =(3 - /9)A^(2,i)(>^) + <5M(i,i,i)(y) 
=(6-7-5)M(i,i,i)(y). 

Since 

AyM(3)(y) =(12m - 6)M(3)(y) + 12M(2,i)(y) 
AyM(2,i)(y) =(12m - 14)M(2,i)(y) + 24M(i,i,i)(y) 
AyM(i,i,i)(y) =12(m - 2)M(i,i,i)(y), 

it follows from Lemma 13.21 that 

AyC(3)(y) = (12m - 6)C(3)(y), AyC(2,i)(y) = (12m - 14)C(2,i)(y). 



3 18 

From the above equations, we can deduce that f3 = — , 7 = 2, 6 = — . Therefore, 

2 5 

we have three zonal polynomials for Hermitian quaternion matrices when k = 3 as 
follows: 

C^s)iY) =M(3)(F) + |-M(2,i)(y) + 2M(i,i,i)(F) 

C^,,,)iY) =|M(2,i)(y) + ^M(i,i,i)(y) 

Cii,i,i)iY) =|m(i,i,i)(F). 

In general, let k be a partition of k. Then Ci^{Y) can be expressed in terms of 
monomial symmetric functions as 



a(y) = ^c(«,,)M(,)(r). 



By Lemma 13.21 we obtain that the coefficients C(k,a) are determined by the following 
equation: 

C{n,X) - 2^ C(«,^), (17) 

m 

where Pn = Yl ^iih - 4z), A = (/i, . . ., Im) and fi = {k, . . .Ji + t, . . - t, . . ., Im) for 

i=l 

t = 1, ■ ■ ■ ,lj such that, when the parts of the partition /x are arranged in descending 
order, fi is above A and below or equal to k. The summation in (|T7|) is over all such 
^, including possibly, non-descending ones, and any empty sum is taken to be zero. 

For example, when /c = 4, we have five partitions (4), (3, 1), (2, 2), (2, 1, 1), (1, 1, 1, 1). 
Then the zonal polynomial C(4)(y) has the form 

C(4)(F) =M(4)(r) + C(4)(3,l)M(3,i)(r) + C(4),(2,2)M(2,2)(F) 

+ C(4),(2,l,l)Af(2,l,l)(^) + C(4), (1,1,1, 1,1, 1)(^)- 

By (11), we have 

P(4) = 0, P(3,i) = -10, P(2,2) = -16, P(2,l,l) = -22, P(l, 1,1,1) = -36. 

4x4 8 

Let K = (4), A = (3,1). Then by ( ITTll . C(4)(3 n = x 1 = — . The coefficient 

10 5 

C(4),(2,2) comes from the partitions (3, 1), (4), so 

4x2 8 4x4 9 

C(4)(2,2) = ^X- + ^Xl = -. 

Since the coefficient C(4),(2,i,i) comes from the partitions (3, 1,0), (3, 0, 1), (2, 2, 0), 

4x3 8 4x2 9 12 
^(^)'(^'^'^) = 2x^x- + ^x- = -. 

Noting that the coefficient C(4)^(i^i^i_i) comes from the partitions (2, 0, 1, 1), (2, 1, 0, 1), 
(2, 1, 1, 0), (1, 2, 1, 0), (1, 2, 0, 1), '(l,'l, 2, 0), we have 

4x2 12 16 
C(4),(l,l,l,l) = 6 X ^ X - = -. 
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We list the coefficients of Mx{Y) in Ck{Y) for quaternion matrix Y in the Table. 
We see that these coefficients are different from these in the real cases given in P, 
p238]. 

Table: Coefficients of monomial symmetric functions Mx{Y) in Ck{Y) 



k = 2, 





A 






(2) 


(1,1) 


(2) 


1 


4/3 


(1,1) 





2/3 



/c = 3, 

A 





(3,0) 


(2,1) 


(1,1,1) 






(3,0) 


1 


3/2 


2 






(2,1) 





3/2 


18/5 






(1,1,1) 








2/5 






4, 


















A 








(4) 


(3,1) 


(2,2) 


(2,1,1) 


(1,1,1,1) 


(4) 


1 


8/5 


9/5 


12/5 


16/5 


(3,1) 





12/5 


16/5 


104/15 


64/5 


(2,2) 








1 


4/3 


16/5 


(2,1,1) 











4/3 


32/7 


(1,1,1,1) 














8/35 



k = 5, 





(5) 


(4,1) 


(3,2) 


A 

(3,1,1) 


(2,2,1) 


(2,1,1,1) 


(1,1,1,1,1 


(5) 


1 


5/3 


2 


8/3 


3 


4 


16/3 


(4,1) 





10/3 


5 


220/21 


90/7 


160/7 


800/21 


(3,2) 








3 


4 


26/3 


16 


32 


(3,1,1) 











20/7 


80/21 


85/7 


200/7 


(2,2,1) 














5/3 


4 


80/7 


(2,1,1,1) 

















1 


40/9 


(1,1,1,1,1) 




















8/63 



Let X he an m X m positive definite quaternion matrix and put 

(dsY = Retr (X-^dXX-^dX) (18) 

where dX = {dxij)mxm- This is a differential form and is invariant under the trans- 
formation X LXL^, here L G Q"^^"^ is invertible. For then dX LdXL^ , so 
that 

Retr (X-^dXX-^dX) -> Reti {{LXL^Y^LdXL" {LXL")-^ LdXL") 

= Retr {X"^dXX~^dX). 
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Put n = 2m^ — m, let x be the n x 1 vector 



X — (xii, Rexi2, . . . , Re Xim, 2:22, • • • , Rex2m, • • • , Xmm, Inia;i2, . . . , lmXm,m-l, 
Jma;i2, . . . , JmXm,™-!, Kma;i2, . . . ,KmXm,m-i)' ■ 

For notational convenience, relabel ). Similar to the real case, we have 

{dsY = Retr {X-^dXX~^dX) = dx'G{x)dx 

where G{x) is an x n nonsingular symmetric matrix. Define the differential operator 
/^*x as 



d 



^\ = deiG{x)-''^Y.^. detG(x)V2^^( 



i=l 



where G'(x) ^ = {g{xy^). Let 



dx 



d 



d 



A;,=detG(x)-V2(- 



dx^ 

d 



then we can write A^^^ as 



detG'(x)^/'G(a; 



dx 



which is invariant under the transformation X —>■ LXL^ [L G 



(19) 

is invertible), 



i.e., A*x — A^xLH- 



The proofs of the above assertions are just the same as in P, p240] and we do 
not show them here. Consider the positive definite quaternion matrix X = HYH^ , 
H G qO{m), Y = diag {yi, . . . , Um)- In terms of H and Y , the invariant differential 
form {dsY given by 0181) can be written as 



{dsf = Retr (X-^dXX'^dX) 

= Retr {Y~^dYY~^dY) - 2Retr (deY-^dQY-^) + 2Retr {dQdQ) 

= E - 2^((Imrf^,,)2 + (Jmrf^,,)2 + [KradOuf) 



i=i 

m 2 I „,2 



i=l 



m 



ViVj 



{{RedOijf + (JmdOijf + (Jmrf^)^ + (Kmdft 



+ 2 ^((Im6?^,,)2 + {Jmdeuy + (Kmrf^,,)2) 

i=l 
m 

- 4^((Re(i%)2 + (Imrf%)2 + (Jmrf^)^ + [Kmda 

i<j 



i=l 



i<j 



ViVj 



{{RedeijY + {ImdeijY + (Jmrf^)' + (Kmd%)') 



{{dy)' {Red9)' (ImdO)' {Jmd9)' {Km d9')G{y) 



f dy \ 
Rede 
Im d9 
Jmd6 

\Kmdej 
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where dQ = {dOij) = H^dH = —dH^H, dy = {dyi, dy2, . . ., dym)' , and 

Red9 ={Red9i2,Red6i3, . . .,Red6m-i,m) , ImdO = (ImdOuyl'^ndOis, . . .,lmd6m-i,m) , 
JmdO ={Jmd9i2, JmdOi^, . . ., Jmd6m_i m) , Km d9 = {Kmd6i2,Kmd6i3, . . .,Kmd6m-i, 

Therefore G{y) has the form 



G{y) 







A 
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Ajii < j) 



-Am—l,m / 



where 



/ 2{yi - y,f 
ViVj 



B 



A ■ ■ 



\ 



ViVj 



ViVj 



V 



2(y^ - yj? 
yiyj ) 



Q Q Q Q Q 
In terms of (fT^ and — , , 7777:, 7777:5 „ „ , the operator A^^ can be expressed as 



dy dR9' 819' dJ9' 8X9' 



A* — A* 



\G{y)\ 



-1/2 




\G{y)\'/'G{y)-' 



( A \ 

8R9 



8 8 8 8 



8R9' 819' 8 J 9' 8K9 



1 

\8K9^ 



are the derivation of Re 9^ Im 9, Jm 9, Km 9 respectively), that 



IS, 



n2 mm 2 Q 

1=1 ^* 



^ Q 1 ™ y.y. / Q2 Q2 

+ (3 - 2m) Y.y^jr- + -.Y. ' ' .^2 + ^ + 



92 



52 



f'8m 2j^iy,-y,Y\8R9l 819^ 839% 8X9% 



+ 



92 



8J91 8K91 
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™ <9 9^ 92 52 

where is given in Definition m Ey = g 1/.^, dm ^ dW ^ dJO^ ^ dK9^ 

second derivation of Re^, lm.6, Jm9, Km^, respectively. It follows from EyCk.(Y) = 
A;Ck(^) and the above equation that 



1 v v- ( d"^ 9^ 9^ 9^ \ 

= K + ^^(4m - 1) + (3 - 2m)k\C^{J) 
= [p^ + 2k{m + l)]C^{X). 

In fact, we could have defined the zonal polynomial Ck(X) for X > in terms of 
the operator A^^^ rather than Ay. Here the definition would be that Ck(X) (= Ck{Y)) 
is a symmetric homogeneous polynomial of degree k in the latent roots yi,--- ,ym 
of X satisfying conditions (i) and (iii) of definition 13.11 and such that C^^X) is an 
eigenfunction of the differential operator A^^. The eigenvalue of A^^ corresponding 
to Ck(X) is, from the above equation, equal to [p^ + 2k{m + 1)]. This defines the 
zonal polynomials for the positive definite quaternion matrix X, and since they are 
polynomials in the latent roots of X their definition can be extended to an arbitrary 
Hermitian quaternion matrix and then to a non-Hermitian quaternion matrix by using 
Ci^{XY) = Ci^{X^/'^Y X^^"^) {X is a positive definite matrix and y is a Hermitian 
matrix) . 

Theorem 3.3. Let Xi,X2 G qS{m) with Xi positive definite. Then 
[ C.{X,HX2H^){dH) = 

J qO{m) ^K\imj 

where (dH) is the normalized invariant measure on qO{m). 
Proof. Let 

UX2) = I C,{X,HX2H''){dH). 

JqO{m) 

It is easy to verify fn{X2) = fK{UX2U^), U G qO{m) so that fn{X2) is a symmetric 
function of X2; in fact, a symmetric homogeneous polynomial of degree k. Set L = 

1 /2 

Xi H and suppose X2 > 0. Then by use of the invariance of A^^^, we have 



A*xMX2) = [ A^^a(XiM2//^)(di/) 

JqO(fn) 

= [ A\fi^{X\''HX2H''xl''){dH) 

JqO(m) 



[ A*x^C,{LX2L''){dH) = [ Alx^^„C,{LX2L''){dH) 

J qO{m) JqO{m) 



[p, + 2k{m + l)]UX: 



2) 



Then /k(X2) must be a multiple of the zonal polynomial Ck(X2), i.e., /k(X2) = 

C (Xi) 

Xi^Cf,{X2). Put X2 = Imi then = J" , . . Finally, we get the result by ana- 
lytic continuation. □ 
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Theorem 13.31 plays a vital role in the next evaluation of many integrals involving 
zonal polynomials. 

Let QTra{a) = / eti {-A)\A\''~'^"'^'^{dA) be the quaternion T-function given in 
Ja>o 

n 

[3] and then Qr„,(a) = 7r'^("-i) ]\ T[a - 2{j - 1)], Rea > 2(n - 1). Set 

i=i 

n 

QTnia, k) = 7r"(""i) JJr[a + kj - 2{j - 1)], Rea > 2(n - 1) - A;„, 

where k = {ki, . . ., kn) is a partition of the integer k: k = ki + k2 + ■ ■ ■ + kn, ki ^ 

k2 > ■ ■ ■ ^ kn Then we have 2(j - l))fc, = 1 , where 

i=i Qr„(a) 

= a{a + 1) ■ ■ ■ (a + j — 1). 

Lemma 3.4. Lei A = {aij)mxm ^ qS{m) with eigenvalues Ai, . . ., (^are a// rea/j. Put 

m m 

n = ^i! ^2 = ^ >^Aj, ■ ■ ■ , Tm = Xl- ■ ■ Xm andtTk{A) = Yl det Ai,i2-ifc; 

i=l i<j l<'ti<j2<--<*fe<»Tt 

where Ai-^^i^^... denotes the k x k matrix formed from A by deleting all but the 
ii, . . .,ikth rows and columns. Then rj = ti j{A). 

m 

Proof. We have P{X) = \A — A/m| = ^ (— A)'^rm-fc(Ai, . . ., A^). We also can get 

m 

\A — XIm\ = i~X)''tT m~k{A) hj the definition of the determinant of a quaternion 

A;=0 

matrix given in [12]. The assertion follows. □ 



Lemma 3.5. Let Y = diag {yi, y2, ■ ■ ., ym) be a real diagonal matrix and X = {xij)mxm 
be a m X m positive definite quaternion matrix. Then 





Xl2\ 


k2-k3 


■ \x\ 


\X2l 


X22) 







I ^T7 



C,iXY) = d^y'l^---ytx1\-'' 

(20) 

where n = (fci, ■ ■ ■ , km), d^ is the coefficient of the term of highest weight in Ck(-). 

If Z = diag {zi, Z2, ■ ■ ., Zm) is a real diagonal matrix and Y = {yij)mxm is a m x m 
positive definite quaternion matrix, then 

C,{Y-^Z) =d,zf- ■ ■ ■ z'^y'.r"''"' f^" ^''1 ''rn-^-k^-i 

V2/21 1/22 J 

+ terms of lower weight, 

where n = (fci, . . ., k^), d^ is the coefficient of the term of highest weight in C^{-). 

Proof. Let A e qS{m) and ai, . . ., be its real eigenvalues. Then 

Ck{A) =di^ai^ ■ ■ ■ + terms of lower weight 

=di^ai^"^^ {aia2)''^~''^ ■ ■ ■ (aia2 ■ ■ ■ 0^)^™ + terms of lower weight 

m m 

=d'K.C^ cti)^^"^^^ O'iO'jT'^'^''^ ■ ■ ■ {ciia2 ■ ■ ■ am)''"' + symmetric terms 

i=l i<j 

=dfir\^~'''^r2^~''^ ■ ■ -r^" + symmetric terms. 
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On the other hand, by Lemma [3.41 

C^{A) =d^ti i{A)^^~^Hr 2iA)^^~''^ ■ ■ ■tr„(A) + symmetric terms 

,, , (7io\ ^2-^3 



k2 


( On 


«12 \ 




\a2i 


022/ 



Set A = XY, ttij = XijUj. We have 







k2-k3 




\a;2i 


X22) 







Similarly, we can get the second assertion. □ 

Let A = Ai + A2i + Asj + A^k e Q"'''" and put re (A) = Ai + A2i + A^j. Let 
$m = {T G gS{m) \ re (T) > 0}. is called the generalized right half plane. 

Theorem 3.6. Let Z e ^rn and Y G qS{m). Then 

[ etT{-XZ)\Xr'"'+'C^{XY){dX) = {a),QTUa)\ZrC^{YZ-'), 
Jx>o 

for Re (a) > 2(m — 1) and 

f etr (-XZ)|X|"-2-+ic^(x-iF)(rfX) = (-l)^'Qr^(^) |z|""C^(yZ) 
Jx>o (-a + 2m-l)« 

for Re (a) > 2(m — 1) + ki, where we set = 1 and (a)^ = 1 when k = (0). 

Proof. For Z = 7^, we should prove the following equation 



etT{-X)\Xr'"'+'C^{XY){dX) = {a),QT^{a)C^{Y). 

x>o 

Let f{Y) = [ etr (-X)|X|"-^'"+^C«(Xy)(rfX) and put 5 = H^XH, H G ^©(m). 
Then {dS) = {dX) and 

f{HYH^)= ! etT{-X)\X\''-^"'+^C^{XHYH"){dX) 
Jx>o 

eti {-S)\S\''~^"'-^'C,{SY){dS) = f{Y) 



and hence 



fix) = f f{Y){dH) = f f{HYH''){dH) 

JqOim) JqO{m) 

= [ etr(-X)|Xp-2'"+i / C^{XHYH^){dH){dX) 
= [ etr(-X)|Xr-2-+i^4^]^^(rfX) 
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Xl2\ 






\X21 


X22) 







Since f{Y) is a symmetric homogeneous polynomial in the latent of Y , it can be 
assumed without loss of generality that Y is diagonal, Y = diag {yi, . . . , y^), using (i) 

of Definition EH f{Y) = ^^d^yl^ ...yk^ + ...^ since 

f{Y) = [ etr {-X)\Xr'^^'d.y',^ ■ ■ -i/^x 
Jx>o 

■^11 

Put X = T"T, where T is a upper triangular with positive diagonal elements. Then 

m ^ \ m 

X = '^tfjUj, Xii = tl^, f ^1 J^^j = t\^tl2, ■ ■ ■ \X\ = Wtii 

i<j ^ ^ i=l 

(Lemma 12.11 (2)). By Lemma 12. 3[ 

m = exp - ^ t^u, n ^^r''"^'^^?/!^ ■ ■ ■ 



i=l i=l i<j 



m 



--d.yl' ■ ■ ■ ?/^7r-(™"i) H T{a + h - 2{i - 1)) + ■ ■ ■ 

i=l 

--d.yi'---yt{a).QTM + --- . 



By comparing the coefficients of the two expressions of f{Y), we have ^ , j 
(a)«Qr^(a). 

When Z > 0, let 1/ = Z'^/^XZ^/'^. Then {dV) = {Zlf'-^dX) and 

[ etT{-XZ){detXy-^"'+^C^{XY){dX) 
Jx>o 

= \Z\~'' [ etr(-Z^i/Vzi/2)|yp-2m+i^^(y^-i/2y^-i/2)^^^^ 
Jx>o 

= \Z\~'' [ etr(-y)|y|'^-2™+iC,(VZ-i/2y^-i/2)(^y) 
Jx>o 

= \Z\~-ia)^QTMC,iYZ~'). 

Finally, by analytic continuation, we get the result on $m since the left-side of the 
integrations in the theorem is absolutely convergent in n 

Definition 3.7. If f{X) is a function of the positive definite mxm quaternion matrix 
X, the Laplace transform of f{X) is defined to he 



g{Z) = = / etTi-XZ)fiX)idX) 

Jx>o 

which is absolutely convergent for Z G $m- Note that C{-) is one to one for Z —P G 
where P is a complex positive definite matrix (cf. p]). 
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Theorem 3.8. Let Y G gS{m). Then 

Jo<x<i„ QT^{a + b,K) 



'0<X<1 

for Re (a) > 2(m - 1), Re (b) > 2{m - 1) and 



Jo<x<im Q^m{a + b, -k) 

for Re (a) > 2(m - 1) + h, Re (6) > 2(m - 1). 

Proof Let /(F) = /" - It is easy to check 

J0<X<Im 

that f{Y) = f{HYH^), H e ,0(m) and = by Theorem 

13. 3[ Take Z = 1^ and y = in Theorem 13.61 Then 

/ etT{-W)\W\''+''-^"'+'f{W){dW)= [ etr(-Vt^)|Vf^r+^-2-+^^^^%^^!^((iW) 
ivy>o Jw>o ^K(/m) 



'my 

_ii III 



Vl/>0 



=/(J^)Qr„(a + 6, 

Set X = iy-V2[/vi/-V2 Then 

etr (-H^)|H^|"+*"2m,+iy^^)^^p^^ 

[ etr(-iy)|iy|'*+^-2'"+i /" 

I etr / |f/|a-2m+l|^|-a-b+4m-2|^ _ ^|fe-2m+l 

iiy>o Jo<u<w 

etr (-F -U) I \U\''-^'^+^\V\^-^'^+^C^{U){dV){dU) (for y = - [/) 
f/>o Jv>o 

a-2m+l/^ (TT\(^nT\ I f T/M T/l ^-2m+l / 



etii-U)\Ur'"'^'C^iU)idU) / etr(-y)|y|''-'"^+^(rfV^) 
f/>o Jv>o 

ia,K)QTUb)C^iIJ. 



Corollary 3.9. IfYe qS{m), then 

f \xr^-^^c.{XY){dx) = (-)^ Qr ia)QrU2m-l) 

Jo<x<iJ «l n ; (a + 2m-l)« Qr^(a + 2m-l) ^ 

where Re (a) > 2(m — 1), and k = {ki, k2, . . ., km). 
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4 HYPERGEOMETRIC FUNCTION FOR QUATER- 
NION MATRIX 

Definition 4.1. The hypergeometric functions of a Hermitian quaternion matrix ar- 
gument are given by 

,F,K....<.,;......>,;;.,^gX:|j^^^ (21) 

where ^ denotes summation over all partitions n = {ki, . . ., km), ki ^ ■ ■ ■ ^ km ^ 
ft 

of k and X G qS{m) . 

Remark 4.2. We have the special case o-fo(^) = etr A for A G qS{m). From f^, we 
have 

(1) If p < q, then the hypergeometric series f2l\) converges absolutely for all X ; 

(2) If p = q + 1, then the series ([UP converges absolutely for \\X\\ < 1 and diverges 
for \\X\\ > 1; 

(3) If p > q, then the series l[21\) diverges unless it terminates. 

Definition 4.3. The hypergeometric functions of Hermitian quaternion matrices X, 
Y are given by 

pm/ ^ .> ^ ■ _ • • • Cft(X)C^(y) 

pFq (a,, . . , a„ 6,, . . , 6„ X, y) - ^ ^ ^^^^^ _ _ _ ^^^^^ (22) 

By Theorem 13.31 we have 
Theorem 4.4. IfX, Ye gS{m) with X > 0, then 

I pFqiai,--- ,ap;bi,--- ,K;XHYH''){dH)=pFq^{ai,--- ,ap-bi,--- ,K-X,Y). 

JqO(m) 

By Theorem 13.61 we also have 
Theorem 4.5. Let Z G qS{m) and suppose p ^ q, He (a) > 2(m — 1). Then 

f etT{-XZ){detXr~^'^+\Fq{au--- ,ap,bi,--- ,bq;X){dX) 
Jx>o 

= Qrm(a)(det Z)~%+iFg(ai, ■ ■ ■ , Op, a; 6i, ■ ■ ■ , bg] Z^^) 

and 

f etT{-XZ){detXr-^"'^\Fg"'{ai,--- ,ap;bi,--- ,bg;X,Y){dX) 
Jx>o 

= Qr^(a)(det Z)- ■ ■ ■ , a; 6i, ■ ■ ■ , 6,; Y) 

for all Z G when p < q and for \\ [re (Z)]^^ \\ < 1 when p = q. 
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Corollary 4.6. Let Z e qS{m) with \\Z\\ < 1 and Re (a) > 2(m-l). TheniFo{a; Z) 

Proof. Assume that < Z < /„. By Theorem 14.51 

etr(-XZ-i)|X|"-2'"+ietr {X){dX) = QTm{a)\Z\\Fo{a, Z). 



'x>o 

Let X = Zi/2f/^i/2^ ^i^gj^ ^^x) = \Z\^"'^\dU) by Lemma [221(2) and hence 

I etr(-XZ-^)|X|'^-2'"+^etr(X)(dX) 
Jx>o 

= [ etr(X(/-Z-i))|X|"-2'"+i(rfX) 



etr(-f/(/-Z))|?7|'^-2™+^(rft/). 

'(7>0 



Put P={I- Z)V2[/(/ _ ^)i/2. Then 

/" etr(-f/(/- Z))|t/|"-2'"+^((i?7) 



P>0 

= |/-Zr"Qr^(a). 

Finally, we have iFo(a; Z) = \Im — Z\~°- for Z G qS[m) with < 1, by analytic 
continuity. □ 

Theorem 4.7. Lei X e Q™''" (m < n) and E = {Hi\H2) G qO(n), Hi e 5K^,n. 

r/ien oFi(2n,4XX^) = / exp(4Retr (X//i))(di7). 

Proof. We use the same method as in the proof of Theorem 7.4.1]. Assume that 
rankX = m. Applying the Laplace transform to 1X1^""^™+^ [ exp(4Retr {XHi)){dH) 

and |A:|2"-2™+ioFi(2n,4XA:^), respectively, we have 



0{n) 



gi{Z)=l etr(-XX^Z)|X|f-2'"+i /" exp(4Retr (X//i))((ii/)((iXX* 

JxxH>0 J qO{n) 

gr{Z)= [ etT{-XX"Z)\X\f-^'^+\Fi{2n,AXX^){dXX"). 
Since {dX) = 2-'"|X|2'^-2'"+i(dXX^)([/f dt/i), it follows that 

giiZ) = ^^^^ / / etr (-XX^Z) exp(4Retr iXHMdH){dX). 

^ JXXH>0 JqOin) 

Let Z > and put X = Z'^I'^Y . Then {dX) = and hence 



/ / etr {2{YHiZ-^/^ + Z-^'^H^Y^) - YY^) (dH) (dY) 

JYYHyO J qO(n) 

\7\n 2^netr(4Z-i) I I ,tT{-{Y -2Z~'/'Hf){Y -2Z-'/'H^f){dH){dY). 



.(2n) 
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Note ^^^etr {-{Y-2Z~^/^H^){Y-2Z-^/'^Hl^)^) is the density function of QiV„xn,(2Z-i/2//_ 

2/^ ^In). Thus gi{Z) = Qr^(2n)|Z|--etr (4Z-1). 
On the other hand, by Theorem 14.51 

gr{Z) =QTm{2n) det(Z)"2"iFi(2n, 2ra, 4Z~^) 
=QTm{2n)\Z\-%Fo{4Z-') 
=Qr^(2n)|Z|-"etr {AZ-'). 

Then gi{Z) = gr{Z), W Z E $m by analytic continuation. □ 



5 THE DISTRIBUTION OF EIGENVALUES 

The joint density function of the eigenvalues of complex central Wishart matrix is 
given in [12] and its distribution of the maximum and the minimum eigenvalues is 
shown in [TT]. In this section, we generalize some results in pT| WI\ to the quaternion 
cases. 

Let W = AA^ ~ QW„(n,S) (n ^ m), A ~ QA^(0, /„ S). The density 

m 

function of W is given by (E]). Let W = VDV". Then {dW) = (271^)""' Yl{X, - 

i<j 

\jY{dD) /\{y^dV) by Lemma [2. 5[ Then the differential form of the density of W is 

o2m.n 

exp(Retr (-2S-W))|iy|2"-2-+i(27r2)— JJ(A, - \j)\dD) f\{V''dV). 



.(2n)|S 



2n 



Integrating the above equation on {V^dV), by Theorem 14.41 we have 



^Y^{2n)\n^r. ^M^^^^ {-2T.~'W))\Wr-'-^^\2n'r- \[{\ - X,)\dD) /\iV^dV) 



which gives the joint density of the eigenvalues. When S = cr^/„, the joint density of 
the eigenvalues of W is 



Qr™(2m)Qr^(2n)|a2|2n 



92mn 2m2-2m ™ / 1 ™ \ 

|Dp"-2-+^n(^,-A,rexp(-^^A. (dZ^) (23) 

i<3 ^ j=l ^ 



Let W ~ QVFm(n, E)(n ^ m) and A be a m x m positive definite quaternion 
matrix. We will present the distributions of PiyV > A) and P(W < A) as follows 
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Theorem 5.1. Let W and A be as above. Then 

P{W < A) = ^"''''^^rn{2m - 1) ^ 2n + 2m-l, -2^~'A) 

P{W > A) = E fc, (-2S-^A), 

fc=0 K 

where ^ denotes summation over the partitions k = {ki,...,km) of k with ki ^ 
2n - 2m + 1. 

Proof. By means of the density function of VF in ([S]), we have 

n2mn r 

< ^) = OF ^9 ^lv|2n / exp(Retr (-2S-iK/))|iy|"+^W 

Let = A1/2XA1/2. Then ((iiy) = jAp'^-^rfX. By CoroUary EH we get that 
P{W < A) = P(X < /) 

n2mn r 

/ exp(Retr(-2S-^A^/2j^A^/2)|A|2"-2-+i|X|2"-2-+i|A|2'"-i((iX) 
Qrm(2ri)|E| " Jq<x<i 

[ etr (-2S-^Ai/2^Ai/2))|^|2n-2m+i^^^^ 

fc = |K|=fc 

j2 J2 <Qr,n(2r2)Qr^(2m - 1) a(-2S-iA) (2n)« 



22mn 




2n 


Qr„,(2ri) 




2n 


22mn 


IA 


2n 


Qr„(2n) 




2n 


22mn 


IA 


2n 



Qr^(2n) |S|2" ^^^^ Qr(2n + 2m-l) fc! (2n + 2m-l)^ 

22™"Qr„,(2m- 1) |A|2" ^ , ^ 

Note that 

Put W = Ai/2(J + X)Ai/2. Then rfW^ = |A|2™-i((iX) and so 
P{W > A) 

22mn I /\ 1 2n 



m.(2n)|S| 

22mn I ^ 1 2n 



,(2n)|S| 



- /" etr(-2S-iA)etr(-2S"iA^/'XAi/2)|j^^|2„-2m+i(^^^ 
Jx>o 

- [ etr (-2S-1 A) x etr {-2J:^^A^/^XA^^^) 



'X>0 

Since 

|j^^-l|2n-2m+l = ^f^^^_2n + 2m. - 1 , -X'^) 

^ „.(2„^.+i) ^ [_(2,_2^ + i)]^c^(x-^)(_i)^ 
^ ^ k\ 

k=0 K 
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by Corollary 14.61 it follows from Theorem 13.61 that 

[ etr (-2S-^A)etr {-2J:-^A^/^XA^/^)\I + 
Jx>o 

m(2n—2m+l) / x ; r t 

k=0 



X 



Jx>o 



'X>0 
m(2n-2m+l) 

fc=0 

Therefore, we obtain the result. □ 

Corollary 5.2. Let ~ QWm{n, S) (n ^ m) and let Amax o'l-f^ Amin the largest 
and smallest eigenvalue of W respectively. Then distribution of X^a,^ (resp. Xmm) is 
given by 

m,(2n-2m+l) f9^V-l^ 

P(A^in>x)= 5^ E tl (25) 

fc=0 re 

r/ie density o/ Amax (^resj). Aminy' obtained by differentiating [24\ ) (resp. (25\) ) with 
respect to x. 

Proof. The inequality Amax < x (resp. Amin > x) is equivalent to < xlm (resp. 
W > xlm)- The assertions follow by taking A = xl^ in Theorem 15. 1[ □ 

Acknowledgement. The authors are grateful to the referee for his (or her) helpful 
comments and kindly pointing out many typos in the paper. 
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